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IN THE CLAIMS 

This listing of claims will replace all prior versions and listings of claims in the 
application. An identifier indicating the status of each claim is provided. 
Listing of Claims: 

1 . (Previously Presented) An apparatus comprising: 

memory means for storing relationship information generated by learning based 
on camera motion estimation information for learning expressing motion of a video camera, 
which is detected by a desired image signal picked up by the video camera, and camera motion 
information for learning expressing physical motion of the video camera, which was obtained by 
a sensor for detecting physical motion at the same time when the desired image signal was 
picked up by the video camera; 

camera motion estimation information detection means for detecting camera 
motion estimation information with respect to an inputted image signal, from the inputted image 
signal; and 

camera motion prediction information generation means for generating camera 
motion prediction information with respect to the inputted image signal, based on the camera 
motion estimation information of the inputted image signal detected by the camera motion 
estimation information detection means and the relationship information; 

wherein the desired image signal is a signal obtained for learning processing that 
is performed automatically by a learning section of said apparatus. 
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2. (Withdrawn) The apparatus according to claim 1 , further comprising 
vibration signal generation means for generating a vibration signal for vibrating 

an object. 

3. (Withdrawn) The apparatus according to claim 2, further comprising drive 
means for driving the object, based on the vibration signal. 

4. (Withdrawn) The apparatus according to claim 2, further comprising a chair as 

the object. 

5. (Withdrawn) The apparatus according to claim 4, further comprising display 
means for displaying the input image signal in synchronization with the drive means. 

6. (Withdrawn) The apparatus according to claim 1 , wherein the camera motion 
estimation includes a motion vector detection section for detecting a motion vector from the 
inputted image signal, a motion center detection section for detecting a motion center, based on 
the motion vector, and a camera motion estimation information detection section for detecting 
the camera motion estimation information, based on the motion vector and the motion center. 



7 - 8. (Canceled) 
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9. (Withdrawn) The apparatus according to claim 6, wherein the motion vector 
detection section detects the motion vector, with respect to a plurality of preset representative 
points of the inputted image signal. 

10. (Withdrawn) The apparatus according to claim 1, comprising an acceleration 
sensor as the sensor. 

11. (Withdrawn) The apparatus according to claim 1, comprising an angular 
speed sensor as the sensor. 

12. (Previously Presented) The apparatus according to claim 1, 

wherein the camera motion estimation information detection means generates the 
camera motion estimation information which is constructed by information of plural kinds of 
motions. 

13. (Original) The apparatus according to claim 1, wherein the camera motion 
prediction information generation means generates the camera motion prediction information 
corresponding to the inputted image signal, by a linear combination of the camera motion 
estimation information and the relationship information. 

14. (Withdrawn) A learning apparatus comprising: 

camera motion estimation information detection means for detecting camera 
motion estimation information from a desired image signal picked up by a video camera; and 
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coefficient generation means for generating a conversion coefficient for 
generating camera motion prediction information for learning expressing motion of the video 
camera which picked up an arbitrary image signal, from the arbitrary image signal, based on 
sensor signal expressing physical motion of the video camera, which is obtained by a sensor for 
detecting physical motion, at the same time when the desired image signal was picked up, and 
the camera motion estimation information; 

wherein the desired image signal is a signal obtained for learning processing that 
is performed automatically by a learning section of said apparatus. 

15. (Withdrawn) The apparatus according to claim 14, wherein the camera 
motion estimation includes a motion vector detection section for detecting a motion vector from 
the inputted image signal, a motion center detection section for detecting a motion center, based 
on the motion vector, and a camera motion estimation information detection section for detecting 
the camera motion estimation information, based on the motion vector and the motion center. 

16-17. (Canceled) 

18. (Withdrawn) The apparatus according to claim 15, wherein the motion vector 
detection section detects the motion vector, with respect to a plurality of preset representative 
points of the inputted image signal. 

19. (Withdrawn) The apparatus according to claim 15, comprising an 
acceleration sensor as the sensor. 
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20. (Withdrawn) The apparatus according to claim 15, comprising an angular 
speed sensor as the sensor. 



21. (Withdrawn) The apparatus according to claim 15, 

wherein the camera motion estimation information detection means generates the 
camera motion estimation information which is constructed by information of plural kinds of 
motions. 



22. (Currently Amended) An information processing method comprising the steps 

of: 

generating relationship information generated by learning based on camera 
motion estimation information for learning expressing motion of a video camera, which is 
detected by a desired image signal picked up by the video camera, and camera motion 
information for learning expressing physical motion of the video camera, which was obtained by 
a sensor for detecting physical motion at the same time when the desired image signal was 
picked up by the video camera; 

detecting camera motion estimation information with respect to an inputted image 
signal, from the inputted image signal; and 

generating camera motion prediction information with respect to the inputted 
image signal, based on the camera motion estimation information of the inputted image signal 
detected and the relationship information; 
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wherein the desired image signal is a signal obtained for learning processing that is 
performed automatically by a learning section of saM -a learning apparatus. 

23. (Withdrawn) The method according to claim 22, further comprising a step of 
generating a vibration signal for vibrating an object. 

24. (Withdrawn) The method according to claim 23, further comprising a step of 
driving the object, based on the vibration signal. 

25. (Withdrawn) The method according to claim 24, wherein a chair is used as 
the object in the step of driving the object. 

26. (Withdrawn) The method according to claim 24, further comprising a step of 
displaying the input image signal in synchronization with the driving. 

27. (Withdrawn) The method according to claim 22, wherein the step of detecting 
the camera motion estimation information includes a step of detecting a motion vector from the 
inputted image signal, a step of detecting a motion center, based on the motion vector, and a step 
of detecting the camera motion estimation information, based on the motion vector and the 
motion center. 

28 - 29. (Canceled) 
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30. (Withdrawn) The method according to claim 27, wherein in the step of 
detecting the motion vector, the motion vector is detected with respect to a plurality of preset 
representative points of the inputted image signal. 

3 1 . (Withdrawn) The method according to claim 22, wherein in the step of 
generating the relationship information, the relationship information is generated, based on 
camera motion information expressing physical motion of the video camera, which was obtained 
by an acceleration sensor as the sensor. 

32. (Withdrawn) The method according to claim 22, wherein in the step of 
generating the relationship information, the relationship information is generated, based on 
camera motion information expressing physical motion of the video camera, which was obtained 
by an angular speed sensor as the sensor. 

33. (Previously Presented) The method according to claim 22, 

wherein in the step of detecting the camera motion estimation information, the 
camera motion estimation information which is constructed by information of plural kinds of 
motions. 

34. (Original) The method according to claim 22, wherein in the step of 
generating the camera motion prediction information, the camera motion prediction information 
corresponding to the inputted image signal is generated by a linear combination of the camera 
motion estimation information and the relationship information. 
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35. (Withdrawn) A learning method comprising the steps of: 

detecting camera motion estimation information from a desired image signal 
picked up by a video camera; and 

generating a conversion coefficient for generating camera motion prediction 
information for learning expressing motion of the video camera which picked up an arbitrary 
image signal, from the arbitrary image signal, based on sensor signal expressing physical motion 
of the video camera, which is obtained by a sensor for detecting physical motion, at the same 
time when the desired image signal was picked up, and the camera motion estimation 
information; 

wherein the desired image signal is a signal obtained for learning processing that 
is performed automatically by a learning section of said apparatus. 

36. (Withdrawn) The method according to claim 35, wherein the step of detecting 
the camera motion estimation information includes a step of detecting a motion vector from the 
inputted image signal, a step of detecting a motion center, based on the motion vector, and a step 
of detecting the camera motion estimation information, based on the motion vector and the 
motion center. 

37 - 38. (Canceled) 

39. (Withdrawn) The method according to claim 36, wherein in the step of 
detecting the motion vector, the motion vector is detected with respect to a plurality of preset 
representative points of the inputted image signal. 
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40. (Withdrawn) The method according to claim 36, wherein in the step of 
generating the conversion coefficient, the conversion coefficient is generated, based on camera 
motion information expressing physical motion of the video camera, which was obtained by an 
acceleration sensor as the sensor. 

41. (Withdrawn) The method according to claim 36, wherein in the step of 
generating the conversion coefficient, the conversion coefficient is generated, based on camera 
motion information expressing physical motion of the video camera, which was obtained by an 
angular speed sensor as the sensor. 

42. (Withdrawn) The method according to claim 36, 

wherein in the step of detecting the camera motion estimation information, the 
camera motion estimation information which is constructed by information of plural kinds of 
motions. 

43. (Currently Amended) A computer-readable storage medium storing a 
program that when executed by a computer causes the program recording medium which records - 
a program for l e tting a computer to_execute information processing, the program comprising the 
steps of: 

generating relationship information generated by learning based on camera 
motion estimation information for learning expressing motion of a video camera, which is 
detected by a desired image signal picked up by the video camera, and camera motion 
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information for learning expressing physical motion of the video camera, which was obtained by 
a sensor for detecting physical motion at the same time when the desired image signal was 
picked up by the video camera; 

detecting camera motion estimation information with respect to an inputted image 
signal, from the inputted image signal; and 

generating camera motion prediction information with respect to the inputted 
image signal, based on the camera motion estimation information of the inputted image signal 
detected and the relationship information; 

wherein the desired image signal is a signal obtained for learning processing that 
is performed automatically by a learning section of satd -a learning a pparatus. 

44. (Withdrawn) The medium according to claim 43, wherein the program further 

comprises 

a step of generating a vibration signal for vibrating an object. 

45. (Withdrawn) The medium according to claim 44, wherein the program further 
comprises a step of driving the object, based on the vibration signal. 

46. (Withdrawn) The medium according to claim 45, wherein a chair is used as 
the object in the step of driving the object. 

47. (Withdrawn) The medium according to claim 45, wherein the program further 
comprises a step of displaying the input image signal in synchronization with the driving. 
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48. (Withdrawn) The medium according to claim 43, wherein the step of 
detecting the camera motion estimation information includes a step of detecting a motion vector 
from the inputted image signal, a step of detecting a motion center, based on the motion vector, 
and a step of detecting the camera motion estimation information, based on the motion vector 
and the motion center. 

49 - 50. (Canceled) 

51. (Withdrawn) The medium according to claim 48, wherein in the step of 
detecting the motion vector, the motion vector is detected with respect to a plurality of preset 
representative points of the inputted image signal. 

52. (Withdrawn) The medium according to claim 43, wherein in the step of 
generating the relationship information, the relationship information is generated, based on 
camera motion information expressing physical motion of the video camera, which was obtained 
by an acceleration sensor as the sensor. 

53. (Withdrawn) The medium according to claim 43, wherein in the step of 
generating the relationship information, the relationship information is generated, based on 
camera motion information expressing physical motion of the video camera, which was obtained 
by an angular speed sensor as the sensor. 
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54. (Previously Presented) The medium according to claim 43, 

wherein in the step of detecting the camera motion estimation information, the 
camera motion estimation information which is constructed by information of plural kinds of 
motions. 

55. (Original) The medium according to claim 43, wherein in the step of 
generating the camera motion prediction information, the camera motion prediction information 
corresponding to the inputted image signal is generated by a linear combination of the camera 
motion estimation information and the relationship information. 

56. (Withdrawn) A recording medium which records a program for letting a 
computer execute learning processing, the program comprising the steps of: 

detecting camera motion estimation information from a desired image signal 
picked up by a video camera; and 

generating a conversion coefficient for generating camera motion prediction 
information for learning expressing motion of the video camera which picked up an arbitrary 
image signal, from the arbitrary image signal, based on sensor signal expressing physical motion 
of the video camera, which is obtained by a sensor for detecting physical motion, at the same 
time when the desired image signal was picked up, and the camera motion estimation 
information; 

wherein the desired image signal is a signal obtained for learning processing that 
is performed automatically by a learning section of said apparatus. 
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57. (Withdrawn) The medium according to claim 56, wherein the step of 
detecting the camera motion estimation information includes a step of detecting a motion vector 
from the inputted image signal, a step of detecting a motion center, based on the motion vector, 
and a step of detecting the camera motion estimation information, based on the motion vector 
and the motion center. 

58 - 59. (Canceled) 

60. (Withdrawn) The medium according to claim 56, wherein in the step of 
detecting the motion vector, the motion vector is detected with respect to a plurality of preset 
representative points of the inputted image signal. 

61 . (Withdrawn) The medium according to claim 56, wherein in the step of 
generating the conversion coefficient, the conversion coefficient is generated, based on camera 
motion information expressing physical motion of the video camera, which was obtained by an 
acceleration sensor as the sensor. 

62. (Withdrawn) The medium according to claim 56, wherein in the step of 
generating the conversion coefficient, the conversion coefficient is generated, based on camera 
motion information expressing physical motion of the video camera, which was obtained by an 
angular speed sensor as the sensor. 
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63. (Withdrawn) The medium according to claim 56, 

wherein in the step of generating the camera motion estimation information, 

camera motion estimation information which is constructed by information of plural kinds of 

motions. 



64. (Currently Amended) An information processing method comprising the 

steps of: 

detecting from an inputted image signal camera motion information with respect 
to the inputted image signal; and 

detecting camera motion prediction information with respect to the inputted image 
signal, based on the detected camera motion information and relationship information generated 
by learning based on camera motion estimation information for learning that expresses motion of 
a video camera, which is detected by a desired image signal picked up by the video camera, and 
camera motion information for learning that expresses physical motion of the video camera, 
obtained by a sensor for detecting physical motion at the same time that the desired image signal 
was picked up; 

wherein the desired image signal is a signal obtained for learning processing that 
is performed automatically by a learning section of said -a learning apparatus. 



65. (Withdrawn) The method according to claim 64, wherein the relationship 
information is generated based on the camera motion information that expresses physical motion 
of the video camera, obtained by an acceleration sensor. 
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66. (Withdrawn) The method according to claim 64, wherein the relationship 
information is generated based on the camera motion information that expresses physical motion 
of the video camera, obtained by an angular speed sensor. 

67. (Currently Amended) A computer-readable storage medium for storing a 
program that when executed by a computer processes information, the program p rogram 
recording m e dium on which is rec or d e d a program for controlling a computer to execute 
information processing by comprising the steps of : 

detecting from an inputted image signal camera motion information with respect 
to the inputted image signal; and 

detecting camera motion prediction information with respect to the inputted image 
signal, based on the detected camera motion information and relationship information generated 
by learning based on camera motion estimation information for learning that expresses motion of 
a video camera, which is detected by a desired image signal picked up by the video camera, and 
camera motion information for learning that expresses physical motion of the video camera, 
obtained by a sensor for detecting physical motion at the same time that the desired image signal 
was picked; 

wherein the desired image signal is a signal obtained for learning processing that 
is performed automatically by a learning section of satd- a learning apparatus. 

68. (Withdrawn) The medium according to claim 67, wherein the relationship 
information is generated based on the camera motion information that expresses physical motion 
of the video camera, obtained by an acceleration sensor. 
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69. (Withdrawn) The medium according to claim 67, wherein the relationship 
information is generated based on the camera motion information that expresses physical motion 
of the video camera, obtained by an angular speed sensor. 

70. (Withdrawn) An apparatus comprising: 

memory means for storing relationship information generated by learning based on 
camera motion estimation information for learning expressing motion of a video camera, which 
is detected by a desired image signal picked up by the video camera, and camera motion 
information for learning expressing physical motion of the video camera, which was obtained by 
a sensor for detecting physical motion at the same time when the desired image signal was 
picked up by the video camera; 

camera motion estimation information detection means for detecting camera 
motion estimation information with respect to an inputted image signal, from the inputted image 
signal; and 

camera motion prediction information generation means for generating camera 
motion prediction information with respect to the inputted image signal, based on the camera 
motion estimation information of the inputted image signal detected by the camera motion 
estimation information detection means and the relationship information, wherein the motion 
signal causes a user to experience a live feeling as if said user were riding in said image picked 
up by said video camera; 

wherein the camera motion estimation information for learning is generated based 
on one or more motion vectors in the desired image signal and the camera motion estimation 
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information of the inputted image signal is generated based on a motion vector in the input image 
signal. 

71. (Withdrawn) A learning apparatus comprising: 

camera motion estimation information detection means for detecting camera 
motion estimation information from a desired image signal picked up by a video camera; and 

coefficient generation means for generating a conversion coefficient for 
generating camera motion prediction information expressing motion of the video camera which 
picked up an arbitrary image signal, from the arbitrary image signal, based on sensor signal 
expressing physical motion of the video camera, which is obtained by a sensor for detecting 
physical motion, at the same time when the desired image signal was picked up, and the camera 
motion estimation information, wherein the motion signal causes a user to experience a live 
feeling as if said user were riding in said image picked up by said video camera; 

wherein the camera motion estimation information for learning is generated based 
on one or more motion vectors in the desired image signal and the camera motion estimation 
information of an inputted image signal is generated based on a motion vector in the input image 
signal. 

72. (Withdrawn) An information processing method comprising the steps of: 
generating relationship information generated by learning based on camera 

motion estimation information expressing motion of a video camera, which is detected by a 
desired image signal picked up by the video camera, and camera motion information expressing 
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physical motion of the video camera, which was obtained by a sensor for detecting physical 
motion at the same time when the desired image signal was picked up by the video camera; 

detecting camera motion estimation information with respect to an inputted image 
signal, from the inputted image signal; and 

generating camera motion prediction information with respect to the inputted 
image signal, based on the camera motion estimation information detected and the relationship 
information, wherein the motion signal causes a user to experience a live feeling as if said user 
were riding in said image picked up by said video camera; 

wherein the camera motion estimation information for learning is generated based 
on one or more motion vectors in the desired image signal and the camera motion estimation 
information of the inputted image signal is generated based on a motion vector in the input image 
signal. 

73. (Withdrawn) A learning method comprising the steps of: 
detecting camera motion estimation information from a desired image signal 
picked up by a video camera; and 

generating a conversion coefficient for generating camera motion prediction 
information expressing motion of the video camera which picked up an arbitrary image signal, 
from the arbitrary image signal, based on sensor signal expressing physical motion of the video 
camera, which is obtained by a sensor for detecting physical motion, at the same time when the 
desired image signal was picked up, and the camera motion estimation information, wherein the 
motion signal causes a user to experience a live feeling as if said user were riding in said image 
picked up by said video camera; 
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wherein the camera motion estimation information for learning is generated based 
on one or more motion vectors in the desired image signal and the camera motion estimation 
information of an inputted image signal is generated based on a motion vector in the input image 
signal. 



74. (Withdrawn) A program recording medium which records a program for 
letting a computer execute information processing, the program comprising the steps of: 

generating relationship information generated by learning based on camera 
motion estimation information expressing motion of a video camera, which is detected by a 
desired image signal picked up by the video camera, and camera motion information expressing 
physical motion of the video camera, which was obtained by a sensor for detecting physical 
motion at the same time when the desired image signal was picked up by the video camera; 

detecting camera motion estimation information with respect to an inputted image 
signal, from the inputted image signal; and 

generating camera motion prediction information with respect to the inputted 
image signal, based on the camera motion estimation information detected and the relationship 
information, wherein the motion signal causes a user to experience a live feeling as if said user 
were riding in said image picked up by said video camera; 

wherein the camera motion estimation information for learning is generated based 
on one or more motion vectors in the desired image signal and the camera motion estimation 
information of the inputted image signal is generated based on a motion vector in the input image 
signal. 



Page 21 of 32 



00597925 



U.S. Application No. 10/631,348 PATENT 
Reply to Office Action mailed August 1 8, 2008 450101 -02499. 1 

75. (Withdrawn) A recording medium which records a program for letting a 
computer execute learning processing, the program comprising the steps of: 

detecting camera motion estimation information from a desired image signal 
picked up by a video camera; and 

generating a conversion coefficient for generating camera motion prediction 
information expressing motion of the video camera which picked up an arbitrary image signal, 
from the arbitrary image signal, based on sensor signal expressing physical motion of the video 
camera, which is obtained by a sensor for detecting physical motion, at the same time when the 
desired image signal was picked up, and the camera motion estimation information, wherein the 
motion signal causes a user to experience a live feeling as if said user were riding in said image 
picked up by said video camera; 

wherein the camera motion estimation information for learning is generated based 
on one or more motion vectors in the desired image signal and the camera motion estimation 
information of an inputted image signal is generated based on a motion vector in the input image 
signal. 

76. (Withdrawn) An information processing method comprising the steps of: 
detecting from an inputted image signal camera motion information with respect 

to the inputted image signal; and 

detecting camera motion prediction information with respect to the inputted image 
signal, based on the detected camera motion information and relationship information generated 
by learning based on camera motion estimation information that expresses motion of a video 
camera, which is detected by a desired image signal picked up by the video camera, and camera 
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motion information that expresses physical motion of the video camera, obtained by a sensor for 
detecting physical motion at the same time that the desired image signal was picked up, wherein 
the motion signal causes a user to experience a live feeling as if said user were riding in said 
image picked up by said video camera; 

wherein the camera motion estimation information for learning is generated based 
on one or more motion vectors in the desired image signal and the camera motion estimation 
information of the inputted image signal is generated based on a motion vector in the input image 
signal. 

77. (Withdrawn) A program recording medium on which is recorded a program 
for controlling a computer to execute information processing by: 

detecting from an inputted image signal camera motion information with respect 
to the inputted image signal; and 

detecting camera motion prediction information with respect to the inputted image 
signal, based on the detected camera motion information and relationship information generated 
by learning based on camera motion estimation information that expresses motion of a video 
camera, which is detected by a desired image signal picked up by the video camera, and camera 
motion information that expresses physical motion of the video camera, obtained by a sensor for 
detecting physical motion at the same time that the desired image signal was picked, wherein the 
motion signal causes a user to experience a live feeling as if said user were riding in said image 
picked up by said video camera; 

wherein the camera motion estimation information for learning is generated based 
on one or more motion vectors in the desired image signal and the camera motion estimation 
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information of the inputted image signal is generated based on a motion vector in the input image 
signal. 

78. (Withdrawn) An apparatus comprising: 
memory means for storing relationship information generated by learning based on 
camera motion estimation information expressing motion of a video camera, which is detected 
by a desired image signal picked up by the video camera, and camera motion information 
expressing physical motion of the video camera, which was obtained by a sensor for detecting 
physical motion at the same time when the desired image signal was picked up by the video 
camera; 

camera motion estimation information detection means for detecting camera 
motion estimation information with respect to an inputted image signal, from the inputted image 
signal; 

camera motion prediction information generation means for generating camera 
motion prediction information with respect to the inputted image signal, based on the camera 
motion estimation information detected by the camera motion estimation information detection 
means and the relationship information; 

wherein the desired image signal is a signal for learning; 

camera motion prediction information generation means for generating camera 
motion prediction information with respect to an inputted image signal, based on the camera 
motion estimation information of the inputted image signal detected by the camera motion 
estimation information detection means and relationship information; and 
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vibration signal generation means for generating a vibration signal for vibrating 
an object, by calculating camera motion prediction information. 



79. (Withdrawn) An information processing method comprising the steps of: 

generating relationship information generated by learning based on camera 
motion estimation information expressing motion of a video camera, which is detected by a 
desired image signal picked up by the video camera, and camera motion information expressing 
physical motion of the video camera, which was obtained by a sensor for detecting physical 
motion at the same time when the desired image signal was picked up by the video camera; 

detecting camera motion estimation information with respect to an inputted image 
signal, from the inputted image signal; 

generating camera motion prediction information with respect to the inputted 
image signal, based on the camera motion estimation information detected and the relationship 
information; 

wherein the desired image signal is a signal for learning; 

generating camera motion prediction information with respect to an inputted 
image signal, based on camera motion estimation information of the inputted image signal 
detected by camera motion estimation information and relationship information; and 

generating a vibration signal for vibrating an object, based on the vibration signal. 



80. (Withdrawn) A program recording medium which records a program for 
letting a computer execute information processing, the program comprising the steps of: 



Page 25 of 32 



00597925 



U.S. Application No. 10/631,348 PATENT 
Reply to Office Action mailed August 18, 2008 450101-02499.1 

generating relationship information generated by learning based on camera 
motion estimation information expressing motion of a video camera, which is detected by a 
desired image signal picked up by the video camera, and camera motion information expressing 
physical motion of the video camera, which was obtained by a sensor for detecting physical 
motion at the same time when the desired image signal was picked up by the video camera; 

detecting camera motion estimation information with respect to an inputted image 
signal, from the inputted image signal; 

generating camera motion prediction information with respect to the inputted 
image signal, based on the camera motion estimation information detected and the relationship 
information; 

wherein the desired image signal is a signal for learning; 

generating camera motion prediction information with respect to an inputted 
image signal, based on camera motion estimation information of the inputted image signal 
detected by the camera motion estimation information detection means and relationship 
information; and 

generating a vibration signal for vibrating an object, based on the vibration signal. 
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